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NEW OUTPUT IMPROVEMENTS FOR CLASSY 

Elogic has designed and implemented several improve- 
ments in both the form and content of CLASSY output. These 
improvements fall in four categories: 


1) 

New 

stat 

: stical 

measures 

2) 

Spec 

ial 

mi.p types 

3) 

New 

formats for 

standard outpu 

U) 

Spec 

ial 

c luster 

display method 




New Statistical Measures: 


Coding has been added to CLASSY to calculate some addi- 
tional statistical measures. Some of these arc simply calcu- 
lations made by che output formatting routine from quantities 
already availaole. These new calculations are described in 
the New Formats section, rather than here. 

The new statistical measures calculated by the program 
give information about the relative probability distribution 
of the data. We define r, the fraction of the probability 
for a point which is allocated to a particular cluster, as 

P 

r _ cluster 
r total 

where the r's refer to posterior probabilities. r will al- 
ways be 1 for a well-separated cluster, and will become 
smaller as the cluster becomes more mixed with other clusters 
The distribution of r thus becomes a measure of how directly 
the algorithm can converge, as well as a measure of the separ 
ability of the clusters. 

The new measures give a histogram of r and a special 
statistic useful when r is near 1. For the histogram, the 
values of r are divided into five regions, 3.8-1., 3.6-0. 0, 
0.4-0. 6, 0.2-0. 4, and 0-0.2. The weighted numbers of points 
falling into each of these regions is accumulated during the 
normal CLASSY processing. (Actually, the first region is 
calculated from the other feur and the total weight.) This 
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forms a five point histogram of the weights falling into each 
r-interval, which is printed out in the new cluster printout. 

In addition, the program accumulates the average r in 
the 0.8 "1.0 interval, which is useful when the probabilities 
are generally close to 1. This statistic is also displayed 
in the cluster printout. The formats for both of these sta- 
tistics are given in the New Formats section of this report. 
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Special Map Types 

The map normally produced by CLASSY is a maximum likeli- 
hood classification of each pixel into the clusters generated 
by CLASSY. As part of the additional output designed by 
Elogic, an additional type of map is now available. This se- 
cond map type is auxiliary to the first, and gives an indica- 
tion of tne degree of doubt in which the classifications are 
held. The posterior probability of the best class for each 
pixel is pigeon-holed into 5% intervals, p=95-10i)%, 90-95i, 
etc. These are then printed as a map, which may be compared 
to the original map type. 

This second map type is useful in discovering the rea- 
sons for any misclassif ications with CLASSY. For example, 
if most of the misclassif icaticn in seme region is due tc 
problems with boundary pixels, then the high uncertainty poinc 
will be along the boundaries. Similarly, isolated errors may 
be on points with high uncertainty. 

To access the neond map type, the user uses the MAPTYPE 
command in the control card input. 

MAPTYPE 1 means ordinary map 

MAPTYPE 2 means special nap only 

MAPTYPE 3 means both maps 

The symbol set is different from that used in the or- 
dinary map, and is given at the bottom of the map, along with 
counts for each interval. The SYM3 instruction has been al- 
tered so that hae first character of the parameter string de- 
notes the maptype to which the symbols apply, 
der are the map symbols. 


and une remain- 
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New Formats for Standard Output 

The standard output from CLASSY was generally reforma- 
tted to improve organization and readability/ and to elimi- 
nate extraneous output. The new formats are labeled and ex- 
tensively described in Appendix A. 

The new printouts reformat the cluster printout entirely, 
restructure the ADJUST printout to occupy only one line, and 
omit a great deal of extra printout in the main listing. Ad- 
ditional changes were made in the initial printout, in the 
timing printout, and in the cluster tree printout. Each 
group of printout has been labeled with the total number of 
points processed when it was printed. This gives an effective 
"clock” for relating the different events of a CLASSY run. 
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Special Cluster Display rteihod 

During the course of this contract, Elogic has aloe 
developed a special method for displaying a nul tidimer.s icnal 
cluster in two dinensior.3. 

A typical problem is the display of brightnass-creen- 
:\3S3 covariances for several acquisitions. The brightness- 
greenness ir.fcrnation fer any one pass is easily displayed 
in two dimensions using the covariance ellipse. (Actually, 
it is better to use an ellipse with radius*^ times that of 
the covariance ellipse, to equalise the nunbar of points in- 
side and outside the ellipse.) For several acquisitions, the 
brightness-greenness ellipse can be projected to display each 
acquistion separately, giving one ellipse per pass. However, 
this form of display still ignores any relation between the 
passes. For three acquisitions (six channels) only 9 ele- 
ments of the 21 in the overall covariance are displayed. 

The correlation matrices usually used to generate the 
display acquisition as independent. Elogic has derived an 
additional type of projected correlation matrix which treats 
each acquisition as dependent. Displaying thi3 with the 
standard covariance enlarges the number of items visually a- 
vailable in the 6-channel esse from 9 to 18 (out of 21) . 

It produces ellipses lying inside the covariance ellipses, 
which give the covariance of a point, assuming the other 
channels are given fixed values. 

Suppose wa let P be one of the six-channel to two- 
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channel projection operators. Then the ordinary two-channel 
covariance is P t tP f where S is the six-channel covariance ma- 
trix. The additional (dependent) covariance displays (P^-lp) 
as well, which is the covariance of one pass for fixed spec- 
tral values of the other passes. Since a lot of the variation 
in one pass may be correlated to variations in the other pas- 
ses. holding those latter passes at a fixed value may con- 
siderably reduce the range of variation of the first pass. 

Figure 1 shows the situation for a two-channel to one- 
channel reduction. In this highly correlated example the in- 
ner "ellipse" is much smaller than the outer ellipse. This 
is because the dependent ellipse is a cross-section of the 
covariance rather them the full range as given by the inde- 
pendent ellipse. 

Figure 2 shows some examples of these ellipses for a 
CLASSY run on real Landsat data (the two-ellipse system was 
coded by Lockheed electronics.) As cam be seen, not a great 
deal of the variation is removed by using the dependent ma- 
trices. This means that little of the variation in one pair 
of channels can be explained or predicted by the variation 
in the other channels. To the extent that the passes are 
uncorrelated, improved classification becomes a statistical 
accumulation of data from several passes, rather than a co- 
herent picture of ground color variation. 


Figure 1. 
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Figure 2. Brightness-greenness plot for segment 
1805 (3 acquisitions) . The seperation between inner 
and outer ellipses is relatively large in this example 
(cluster 12 ) , so that most of the variation can De con- 
sidered to be acquisition independent. 
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APPENDIX A 

DESCRIPTION OF PRINTOUT ITEMS 
The names correspond to those on the annotated printout. 

1) Cluster printout — printed occasionally when a cluster is 
adjusted, and for each cluster at the end of an itera- 
tion. This printout is controlled by several switches, 
which delete certain portions of the output, or control 
line length (80 or 132 columns) . The full printout is 
given here, but usually the minimum output is ased. 

The printout is described here for the 132 column 
format; the 80 column format is labeled alike and can 
be understood from this description. 
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a) Main line (always printed) . 

Cluster number — the number assigned by CLASSY to 
the cluster. This number is unique to the 
cluster and consistent throughout a run. 

Cluster symbol — the one-character symbol assigned 
to the cluster for mapping, etc. It changes 
from iteration to iteration. 

Total points clock — total number of points so far 
processed during this CLASSY run. 

Absolute proportion — the proportion assigned to 

the cluster relative to the top of the tree. 

Volume — the cluster volume (,(2 t\) ^/ 2 (det £ ) ^ 2 ) . 

Volume factor — the ratio of the cluster volume 
to its diagonal part (i.e., to the volume 
with all correlations set to 0) 

((det diag£ ) 1/2 /(detS ) 1/2 ) . 

Typical deviation — typical standard deviation in 
one channel (actually the geometric mean 
of all the deviations) 

( ( de t £ ) 1/d ) . 

Sensitivity — the sensitivity of the volume of 
the cluster to the addition of a small 
component of the unit matrix 
(Tdet(*+al) /3oi| a _ 0 »tr £ -1 det£). 

Level — in cluster tree printout, the level of 

the cluster (0 for the nominal top node) ; 
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in other cluster printout, a marker for 
the source of the output. 

Super cluster — the cluster number of the clus- 
ter atove this one. 

Which in super list — the position of this clus- 
ter in the list of subclusters of its 
super cluster. 

Average of good probabili ties — the average of the 
a posteriori probability of all points 
which assign an a posteriori probability 
of 80% or greater to this cluster. 

Pentile percents — (5 numbers). The percentage 
of the weight of the cluster coming from 
points which, give a posteriori probabili- 
ties to this cluster in the five ranges 
(80-100%, 60-80%, 40-60%, 20-40%, 0-20%). 
The points in the first range are those 
used in calculating the average of good 
probabilities above. These measures give 
an indication of how strongly this cluster 
may overlap others. The percentages may 
not add up to 100 due to rounding error. 
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b) Internal values (printout controlled by INTPR) : 

First line: 

Adjust weight — (WADJ) . Weight at which cluster 
will be adjusted. 

Current probability — (PST). Last probability 
assigned to this cluster and its sub- 
clusters. 

Cumulated probability — (CUM). The last (total) 
probability assigned to this clusters' 
subclusters . 

Conditional probability — (PCOND) . The last 
probability assigned to this cluster 
itself. 

Relative proportion — (PROP). The proportion of 
this cluster relative to its sibling clus- 
ters (or to the proportion of the parent 
cluster) . 

Proportion numerator — (CIN) . The proportions 
are kept in the form A/B. This is the 
A factor. 

Proportion denominator — this is the B portion 
(see above) . 

Weight of parent — the current weight of the 
parent cluster. 


i 

I 
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Second line : 

Full cycle adjust — (IDADJ) . The point at which 
the cluster will have "seen" all the data 
and thus require adjustment. 

Last R**2 — (DISS) . The last distance squared of 
a point from the cluster. 

Cumulated prior probability — (PRIRCM) . The last 
sum of the subcluster prior probabilities 
assigned to this cluster. (Near 1.) 

Passed probability — (PPASS) . The probability 
"passed" to this cluster from its parent 
cluster. A temporary. 

Old proportion — (OPROP) . Hie value of the rela- 
tive proportion (c.f.) at the last ADJUST. 

Old proportion numerator — (OCIN) . The value of 
the proportion numerator (c.f.) at the 
last ADJUST. 

Old proportion denominator — (ODEN). The pro- 
portion denominator (c.f.) at the last 
ADJUST. 

Weight not entering denominator — (CTOT) . The 
part of the weight of parent (c.f.) not 
entering the proportion denominator (c.f.). 


I 


<R*»2» 1.6? PRIOR 0.996 PASS 0.81 (OLD) 0.126 146.2 1142.0 -CTOT 2563.8) 


18 


£ full cycle adjust 


last R**2 


cumulated prior probability 


passed probability 


old proportion 


old proportion numerator 


old proportion denominator 


weight not entering denominator 


19 


c) Trace quantities (controlled by TRACPR) . 

Old weight — (OW) . The cluster weight (c.f.) at 
its last ADJUST. 

Volin — (VOLIN). Cluster volume with extra factors. 

Volrt — (VOLRT) . The square root of VOLIN. 

Dcon — (DCON) . A term used to offset various 
volume factors; effective volumetric 
factor for the normal distribution is 
VOLRT * EXP (DCON/2) . 

Cluster index — (KL) . The actual position of the 
cluster in memory. 

Super index — (LSUPER) . The actual position of 
the super cluster in memory. 

Subcluster index — (LSUBS) . The actual position of 
the first subcluster in memory. 

Sibling index — (LINK). The actual position in 
memory of the next cluster on the sibling 
list. 

Sibling number — the cluster number of the next 
sibling. 

Symbol number — (NSYMB) . The number of the 
graphic (see "cluster symbol") used 


for this cluster. 



TRACE: Oil 200.2 VOLIN 0.3I89E-2I 
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d) Subcluster data (always printed) . (This line 
also includes the captions for the mean and 
covari ance . ) 

Weight— (W) . The weight assigned to this 
cluster. 

Variant 1 — "NO SUBS" — means that thi3 cluster has 
no subclusters. 

Variant 2 — (subcluster information): 

Splitting — (SPFAC) . The current value of the 
likelihood ratio between this cluster 
and its subclusters, including the bias 
from the priors. A sufficiently postive 
value will cause the cluster to be sepa- 
rated, a sufficiently negative value 
will cause the subclusters to be elimi- 
nated. 

Specific splitting — (SFFAC/DW) . The average 

contribution of each point to the split- 
ting. 

Difference in nedeis — (from PQRAT) . The average 
(RMS) difference between this cluster and 
its subclusters. When this difference is 
small, it is unlikely that the subcluster3 
will ever give a higher likelihood than 
this parent cluster. 


Number cf oubclus ters — the number of sub- 
clusters this cluster has. 

Subcluster list— the cluster number of each 
subcluster of this cluster. 


fiEM CHAN COVAR: III / U> 374.9 SPLIT -31.73 
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Subcluster data 
variant 2-subclusters exist 
(see first sheet for an 
exanple of variant 1.) 


weight 


splitting 


specific splitting 


difference in models 
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number of subclusters 



subcluster list. 
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e) Mean and covariance (controlled by COVPR) . 

Mean — the cluster mean vector. 

Chan — the alphabetic or numeric label for each 
channel . 

Covar — the cluster covariance matrix. 

f) Old mean and old covariance (controlled by OLDPR) . 

The old values of the mean and covariance, as 

described above. 

g) Skewness and Kurtosis (controlled by KRTPR) . 

Skew — the skewness vector for the cluster. 

Chan — as in mean and covariance. 

Kurtosis- (d+2) * covar — the kurtosis matrix for the 
cluster with part of the covariance matrix 
deducted to make the expectation value zero 
for a true normal distribution. 
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2) Adjust printout — printed each tine a cluster is adjusted. 

Total points clock — total number of points so far pro- 
cessed during this CLASSY run. 

Cluster — the number assigned by CLASSY to the cluster 
being adjusted. This number is unique to the 
cluster and consistent throughout a run. 

Absolute proportion — the proportion assigned to the 
cluster relative to the top of the tree. 

Current weight — (W (XL) ) . The current weight 

assigned to the cluster (before adjustment) . 

Old weight — (OW(KL)). The we i git assigned to the 
cluster at its last adjustment. 

Motion of mean in standard deviations — the total 
motion of the mean measured in terms of the 
variance; the number of standard deviations 
the mean has moved since the last iteration. 

Square of the change in covariance — (tr(£" ) • 

The total squared change in the covariance of 
the cluster since the last iteration. 

Variant 1 (Used for non-split clusters) : 

Trace test (statistic) — the value of the 
trace of the kurtosis test at this 
adjustment (Tr(Z"K) ) . 

Trace test (test compare) — the difference between 
the trace test value and the test success 
threshold? minus means split the cluster. 


2b 


Skewness test (statistic) — the square of the 
skewness at this adjustment (S t S“S) . 

Skewness test (test compare) — the difference 
between the skewness test value and the 
test success threshold; minus means split 
the cluster. 

Kurtosis test (statistic) — the square of the 

traceless part of the kurtosis at this 

adjustment (Tr (£'*K 0 'Xi~K 0 ) , where 

K - K-l 4 (trK/d) ) . 
o 

Kurtosis test (test compare) — the difference 
between the kurtosis test value and the 
test success threshold; minus means split 
the cluster. 


27 


N ^ O* » » 
0« 'O < &• W W NJ 
< W A Ul -• *J A 
KJ G» KJ *0 O "O O 


total points clock 


Adjust printout 
(variant 1) 


L L l. (. L L L 


CD N O 4 QD Ul NJ 

•• •• •• •• •• •• M 

o o o o o o o 

AO\i 
— 04 — O JK CD 
u»>uwooo 


cluster 

absolute proportion 


M A * CK CA Ul 

£ £ - - 2 £ 2 current weight 

- * W KJ O* W Ul 
V S. N. S. N. V 


M KJ KJ KJ KJ KJ 
0> 4k O kJ * ^ 


old weight 


•O O »■ U A 



c 

<= 

<1 


<= 

<= 

o 

o 

o 

o 

o 

o 

o 

o 


o 

1* 

o 

o 

o 

US 

r J 

04 

04 

O' 

04 

KJ 

CD 


KJ 

KJ 

— 

O' 

*o 

VI 

03 

on 


03 

VI 

o- 

O' 

O 

on 

VI 

'O 

04 


J* 

04 

ro 

ro 

VJ 

o 

o 

• 

■ 

• 

• 

• 

• 

• 

KJ 


Vi 

o 

o 

ro 

Ate 

VI 

CD 


ro 

ro 

o 

OD 

o 

-O 

03 

— • 

KJ 

'O 

04 


O' 

O' 

-o 


VI 

KJ 

*• 

on 

O' 



'O 

KJ 

_ 

—4 

—4 


-4 

—4 

—4 


X 

30 

i 

30 

30 

30 


1 

1 

VI 

1 


1 

i 

ro 

KJ 

• 

KJ 

ro 


04 

o 

ro 

on 

>o 

— • 

VI 

• 

■ 

• 

KO 

■ 

• 

• 

-o 

CD 

03 

o 

o 

ro 


•• 

•• 

•• 

30 

• • 

•• 

•• 




2 




on 

on 

on 

on 

-K 

Ate. 

on 

—• 

O' 

ro 



K 4 

o 

on 




CD 

— » 

04 

ro 

o 



>o 

on 

o 

• 

• 

• 


• 

• 

• 

04 


NJ 


on 

VI 

-K 

in 

CO 

in 

o 

CD 

in 

cn 




• 











KJ 


ro 



04 

— 

ro 

'O 

04 


o 


vj 

KJ 

on 



04 

04 

a. 

• 

• 

• 


• 

• 

• 

o* 

CD 

VI 


— 

'O 

O' 


•• 

•• 


• • 

•• 

•• 

A 

04 

on 


O' 

Ate. 

on 

"O 


O' 


04 

o 

o- 

Ate 

KJ 

on 


vi 

04 

on 

• 

• 

■ 


• 

• 

• 

VI 

CD 

on 


— * 

ro 

on 


7Z 





ac 

KJ 

. 






O' 


'O 


on 

on 

on 

04 

on 

O' 


— * 

J* 


o 

-K. 



03 

ro 

OD 

• 

• 

• 


■ 

• 

• 

CD 

o 

A. 


ro 

04 

VI 

•• 

• • 

•• 


•• 

•• 

•• 


ro 

KJ 


ro 


KJ 

ro 

ro 

ro 


.k 

04 

At 

CD 

on 

CD 


CD 

O' 

on 


o 

04 


O' 

OD 

on 

• 

• 

• 


• 

• 

• 

U 

on 

vO 


'C 

O' 

Vi 


motion of the mean in 
standard deviations 


square of the change in 
covariance 


trace test (statistic) 


trace test (test compare) 


showness test (statistic) 


showness test (test compare) 


kurtosis test (statistic) 


kurtosis test (test compare) 
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Variant 2 (Used for split clusters) : 

Splitting — (SPFAC) . The current value of the 

likelihood ratio between this cluster and 
its subclusters, including the bias from 
the prior3. A sufficiently positive value 
will cause the cluster to be separated 
(from PQRAT) . 

Difference in models — (from PQRAT). The average 
(RMS) difference between this cluster and 
its subclusters. 

3) Cluster tree printout (PRTREE) . 

Under several circumstances CLASSY prints out the 
current cluster tree. The tree consists of one item per 
cluster, with subcluster items one liie below the parent 
cluster, directly underneath it and proceeding to the 
right (see figure) . 

Each item consists of a two-digit cluster number 
followed by a code character or followed by 

two digits representing the cluster's percentage pro- 
portion. The code character represents a cluster 
which is not ready to be separated ("-") , and one 
which is ready ("/"). 

Examples : 

01-17 cluster 1, not split, 17% of total 
proportion 


12575 0.05238 


Adjust variant 2 
(split clusters) 


O* 
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•• 
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33 
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tn 


splitting 


o 


difference in models 



I?/ 30 ^ J2-14 N 

11 jit ^ " 00-18 1 3-08 1 4-03 

1 5*06 1 6-05 


09-16^ 03-40 

18-08 19-09 0a-3:V-03 


Tree printout example. Linos have been drawn on 
toe printout to show how the tree structure is expressed. 
The top left cluster should be seperateu. 


75/32 32-12 
03-27 26-04 61-05 
47-11 48-16 55-02 56-02 


62-07 


63/07 23-06 69' 13 

22-05 14-02 64-04 65-02 50-06 19-07 

71-01 


51-07 27-05 33-04 29-09 16-05 

73-05 74-04 

72-05 

77-04 78-01 


Lxtenced example. (Tour level tree) . The items te- 
low the dashed line belong to the right of the upper part 
of the tree. 
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13/85 cluster 13, should be split, 35% of 
total proportion 

4) Iteration printout line. 

Total points clock — total number of points pro- 
cessed by CLASSY this run. 

Number of iterations — che number of times CLASSY 
has processed the complete data sample. 

Time used — the total time used by CLASSY since 
program start (including some time before 
iteration 0}. The time is as provided by 
the system, converted to seconds. 

5) Structural changes lines. 

These are lines printed when a structural change 
is made in the cluster tree, such as splitting, separa- 
ting, or joining clusters. Each of these lines is 
started by the total number of points so far processed, 
followed by an indication of the line time (see below) . 
The cluster tree may be printed out following one of 
these structural changes. 

a) HAVE SPLIT — when a cluster is hypothetically 
split. 

— cluster number. 

Weight — current weight of the split cluster. 

Subs — the cluster numbers of the two new sub- 


clusters . 


32 


Iter — the number of iterations required by 
SPLIT estimating routine. 

b) SEPARATE --when a cluster is to be separated 

(eliminated in favor of its subolusters) . 

— cluster number. 

Super — cluster number of the parent cluster. 

Subs — cluster number of the first subcluster. 

Spfac — the splitting (c.f.) of the cluster. 

Weight — the current weight of the cluster being 
split. 

c) JOINING — when two clusters are joined as a hypothesis 

- AND - the cluster numbers of the two clusters 
being joined. 

TO GET — the newly created join cluster. 

d) ELIMINATE -when a single cluster is being removed 

from the cluster tree. 

— the cluster to be eliminated. 

Link — the first sibling of this cluster. 

Lsubs — the first subcluster of this cluster. 

Lsuper — the parent cluster of this cluster. 

e) SUB ELIM — when all the subclusters of a cluster are 

to be eliminated. 

— the cluster whose subclusters are to be 
eliminated. 

Splitting — the splitting (c.f.) of the current 


cluster. 



33 


+ - tne threshold for sub eliminating a cluster 
from splitting alone. 

?qrat — the RMS difference between this cluster 
and the sum of its subclusters (a low 
PQRAT is the usual reason for SUB ELIMing ' 
a cl us ter i . 
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